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DISTRIBUTED  DETECTION  OF  WEAK  SIGNALS  FROM 


MULTIPLE  SENSORS  WITH  CORRELATED  OBSERVATIONS 

E.  Geraniotis  and  Y.  A.  Chau 

Department  of  Electrical  Engineering 
and  Systems  Research  Center 
University  of  Maryland 
College  Park,  MD  20742 

ABSTRACT 

We  address  two  problems  of  distributed  detection  of  a  weak  signal  from  dependent  obser¬ 
vations.  In  the  first  problem,  two  detectors  must  decide  on  the  basis  of  their  observations 
whether  a  weak  signal  is  present  or  not  The  observations  of  the  two  detectors  consist  of  a 
common  weak  signal  disturbed  by  two  independent  additive  m  -dependent  or  hi  -mixing 
noise  processes.  Fixed-sample-size  (block)  detection  is  employed.  The  decisions  are  coupled 
through  a  common  cost  function,  which  consists  of  the  sum  of  the  error  probabilities  under  the 
two  hypotheses.  In  the  second  problem,  the  observations. of  each  individual  detector  still  con¬ 
sist  of  a  common  weak  signal  disturbed  by  an  additive  m  -dependent  or  hi  -mixing 
noise  process,  but  the  noise  processes  of  the  two  detectors  are  now  correlated.  The  cost  func¬ 
tion  has  a  structure  similar  to  that  of  the  first  problem. 

In  both  cases,  the  detectors  employ  suboptimal  decision  tests  based  on  memoryless  non- 
linearities.  Since  the  signal  is  weak,  large  sample  sizes  are  necessary  to  guarantee  high  quality 
tests  and  the  asymptotic  performance  is  of  interest.  To  determine  the  optimal  nonlinearities  for 
the  two  detectors,  we  identify  new  performance  measures  based  on  two-dimensional  Chemoff 
bounds,  which  correspond  to  the  asymptotic  relative  efficiency  (ARE)  used  for  single-detector 
problems,  and  whose  maximization  implies  the  minimization  of  the  aforementioned  average 
cost  function.  This  optimization  results  in  integral  equations  whose  solution  provides  the 
optimal  nonlinearities.  Numerical  results  based  on  simulation  of  the  performance  of  the  pro¬ 
posed  two-sensor  schemes  are  provided  to  support  the  analysis. 


This  research  was  supported  in  part  by  the  Office  of  Naval  Research  under  contract  N00014-86-K-0013  and  in  part  by  the 
Systems  Research  Center  at  the  University  of  Maryland,  College  Park,  through  the  National  Science  Foundation's  Engineering 
Research  Centers  Program:  NSF  CDR  8803012. 


I.  Introduction 


Decentralized  detection  presents  several  original  research  problems  (see  [1]  and  [2])  be¬ 
cause  classical  optimal  detection  theory  cannot  be  applied  directly  to  practical  distributed 
sensors  systems.  To  make  the  analysis  tractable,  the  models  employed  assume  independent 
data  across  time  and/or  sensors,  while  in  reality,  the  observations  are  always  dependent. 
Indeed,  as  the  locations  of  the  sensors  are  close  geographically  in  many  practical  situa¬ 
tions,  the  noise  is  correlated  and  the  observations  (signal  in  noise)  are  dependent  across 
detectors.  In  this  paper,  the  distributed  detection  of  a  weak  signal  from  dependent  data 
is  addressed;  we  consider  that  two  detectors  working  together  have  to  decide  which  hy¬ 
pothesis  is  true  H o  (signal  absent)  or  H\  (signal  present).  The  signal  is  a  constant  weak 
signal  in  additive  noise;  we  also  assume  that  there  is  no  communication  between  the  two 
detectors,  although  they  are  coupled  through  the  associated  cost  function. 

A  stationary  sequence  is  said  to  be  ^—mixing,  if  for  i  <  1,  j  <  1  and  B\  6 

there  is  a  real  sequence  {^>fc}£L0  such  that 


and 


sup  I P(Bt  n  b2)  -  P(B1)P(B2) I  <  4>JP(B1) 


lim  <t>k  =  0, 

K — ►OO 

where  J-f+j  is  the  a-field  generated  by  and  P[  is  the  a-field  generated  by 

(u)Li- 

Here  the  model  of  dependent  noise  is  described  by  a  stationary  <£— mixing  dependence 
and  each  detector  is  assumed  to  employ  a  memoryless  nonlinearity.  Memoryless  nonlin¬ 
earities  have  been  successfully  applied  in  single-sensor  detection  problems  (see  [3]  and  [4]). 
The  performance  measure  used  for  this  case  is  the  average  cost  of  the  decisions  of  the  two 
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detectors.  We  use  the  central  limit  theorem  for  dependent  random  sequences  (see  [5])  and 
develop  a  two-dimensional  Chernoff  bound  for  the  error  probabilities  of  the  two-sensor  de¬ 
tection  problem.  Then  suitable  exponents  are  chosen  on  the  basis  of  these  bounds  as  the 
objective  functions  for  the  optimal  design  of  distributed  system.  We  derive  the  optimal 
nonlinearities  according  to  these  objective  functions. 

The  remainder  of  this  paper  is  organized  as  follows:  in  Section  II,  we  cite  the  central 
limit  theorem  for  stationary  dependent  random  sequences  and  define  the  expected  cost. 
Then  the  two-dimensional  Chernoff  bound  is  derived.  In  Section  III,  the  case  of  dependent 
data  across  time-  (that  is  the  observations  of  each  sensor  are  dependent  sequences  but 
they  are  mutually  independent  for  the  different  sensors  when  conditioned  on  Hi  (i  =  0, 1) 
being  true)-  is  considered  and  optimal  nonlinearities  are  derived  by  solving  two  decoupled 
linear  integral  equations.  In  Section  IV,  we  consider  a  simple  case  of  dependent  data 
across  time  and  detectors.  In  Section  V,  simulation  results  are  presented  for  both  cases 
described  in  Sections  III  and  IV  for  a  first-order  Markov  dependence  model  and  Gaussian 
as  well  as  Rayleigh  multivariate  joint  probability  density  functions,  of  the  noise  process. 
Finally,  in  Section  VI  conclusions  are  drawn. 
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II.  Preliminaries 


IIA.  The  Weak  Signal  Model  and  the  Central  Limit  Theorem  for  Dependent  Data 

We  consider  the  following  observation  model  of  a  weak  signal  for  two-detector  detection 

H^k)  :  XM  = 

Jjf0  :  XM  =  0  +  N<k\  fc  =  1,2  (1) 

where  6  =  M/y/n  is  the  weak  signal,  {Nfk\i  =  1,  •  •  • ,  n;  k  =  1,2}  a  stationary  <£— mixing 
noise  sequence  with  identical  univariate  distribution  /*  for  k  =  1,2,  and  M  a  known 
positive  constant.  We  attempt  an  asymptotic  analysis  for  large  sample  sizes.  The  detection 
structure  employed  by  each  sensor  is  the  the  same  as  that  of  [3],  namely  the  one  with  a 
memoryless  nonlinearity  gk{-){k  =  1,2).  The  test  statistic  for  each  sensor  has  the  form 

n(x^)  =  x>(4fc)),  *  =  i,2  (2) 

t=i 

The  choice  of  thresholds  is  studied  in  the  next  two  sections.  Here,  we  cite  the  central  limit 
theorem  for  <£— mixing  processes  see  [5]. 

1 

Theorem  1:  Suppose  that  {Yj}^.!  is  a  stationary  ^-mixing  sequence  with  i  4>j  < 
oo  and  that  g  is  a  measurable  function  satisfying 

Eo[g(Yi)]  =  po,  var0[5(Yi)]  <  oo 

Then  the  series 

OO 

<?l{g)  =  var0[ff(Yi)]  +  2  c<w0(g(Y1)3(YJ+1)]  (3) 

;=i 

converges  absolutely.  Furthermore,  if  o%  >  0, 

~J= E?(y;)  "  nMo) 

vn  j= i 
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converges  in  distribution  to  a  normal  distribution  with  mean  zero  and  variance  a q. 
Proof  :  Set  g  =  g-p. o,  thus  £o[?(^i)]  =  0  and  Eo[g2{Y\)\  <  oo.  Then,  the  above  Theorem 
follows  according  to  the  theorem  on  page  174  of  [5]. 

We  consider  memoryless  detectors  with  observations  described  by  (1)  which  employ 
nonlinearities  g k,  k  —  1,2,  that  satisfy  conditions  similar  to  those  presented  in  [3],  i.e., 


Eek[gk ]  <  OO,  var9k{gk)  <  oo 


(4) 


and 

OO 

v9k(gk)  =  +  2^]  covek[gk{Y1)gk(Yj+1)]  >  0  (5) 

i=i 

for  all  9,  where  E9k[gk]  =  p9k(gk)  =  / gk(x)fek(x)dx,  fQk{x)  is  the  marginal  pdf  of 
(and  thus  of  under  Ho)  and  f9k(x)  =  fok(x  —  9)  is  the  marginal  pdf  of  X-k^  under 
H\.  Under  these  conditions  and  from  Theorem  1  we  deduce  that,  under  //,  (for  i  =  0, 1), 
the  test  statistics  Tk  (for  k  =  1,2)  are  asymptotically  normally-distributed  with  means 
nPok(gk),  np9k{gk)  and  variances  ncr$k(gk),  rurjk(gk)  for  all  6.  Furthermore,  as  n  — ►  oo  they 
provide  a  bivariate  normal  distribution  with  the  cross  correlation  functions  npo{g\,g2 )  = 
E[(Ti  -  nnoi)(T2  -  np.02)}  (under  H0 )  and  np9(gi,g2 )  =  E[(Ti  -  np9i)(T2  -  np92)]  (under 
Hi),  whose  forms  for  the  case  of  gi  =  g2  are  derived  in  Section  IV.  Throughout  this  paper 
we  assume  that  p9k  >  p0k  for  k  =  1,2  and  all  9  >  0. 

In  addition,  the  following  regularity  conditions  are  assumed  ([3,  (7)])  for  k  =  1,2  and 


all  9  >  0 


dEe[rk]/d9\s=0  >  0 

lim  ^  =  1 

alk 

lim  —  =  1 

n— °o  jjg 


(6) 

(7) 

(8) 
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and 


f oo  roo 

d[  I  gk(x)fok(x-0)dx]/dd=  d[gk(x)fok(x  -  0)]/d0dx 

J  — oo  J — oo 


(9) 


Therefore,  as  n  — ►  oo,  0  =  M/s/n  — ►  0,  and  we  define 

P12  =  pa  =  pe 


and 


2  2  2 
=  CTofc  = 


for  k  —  1,2. 

IIB.  Performance  Measure  and  the  Two-Dimensional  Chemoff  Bound 
We  use  the  following  cost  function  as  our  performance  measure 


0  if  di  =  d2  =  h 


C(di,d2;h ) 


ci  if  d\  ^  d2 


^  ci  if  d\  =  d?  ^  h, 

where  di,d2,h  €  {0,1},  and  ci  and  C2  are  non-negative  constants.  Thus  average  cost 
which  couples  the  decisions  of  detectors  1  and  2  is 


E[C(dlt  d2;  *)]  =  \Eo[C(dt,  d2;  *)]  +  (1  -  X)El[C{d1,d2] k)\ 

=  A{ci[Po(l,0)  +  Po(0, 1)]  +  c2(l,  1)} 

+(1  -  A){Cl[Pi(l,0)  +  Fi(0,1)]  +  c2(0,0)},  (10) 

where  A  is  the  a  prior  probability  of  Ho  and  Pi  for  i  =  0, 1  are  error  probabilities  under 
Hi.  Thus  jP;(1,0)  =  P,(Ti  >  nr) UT2  <  nrfr),  P;(0, 1)  =  P,(7i  <  nrji ,  T2  >  nrj2 )  for 
i  =  0,1,  P0(l,l)  =  Po(Ti  >  ni]i,T2  >  nr) 2)  and  Pi(0,0)  =  Pi(Ti  <  nTji,T2  <  nrj2),  with 
nr/i(fc  =  1,2)  the  threshold  employed  by  sensor  k. 
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Because  of  the  correlation  of  observations  across  time  and/or  sensors,  there  is  no  closed- 
form  expression  combining  all  terms  in  the  average  cost.  Therefore,  we  derive  a  bound 
on  this  cost  and  use  asymptotic  analysis  for  n  — ►  oo.  First  we  derive  the  two-dimensional 
Chernoff  bound  for  the  general  bivariate  Gaussian  distribution.  Define 


1  if  T\  >  nf?i,T2  >  nrfi 
0  otherwise, 

where  we  assume  that  for  k  =  1,2  Tjt  ~  N(np.ik,  n<?l)  under  Hi  for,  t  =  0, 1,  and  the  pair 
(TuT2)  has  bivariate  Gaussian  distribution  with  the  normalized  correlation  coefficient 
P12  =  np\il {\/n(T\'/n<T2)  =  P\2l{°\°2)-  Then  for  >  0,s2  >  0 


<  e»i r,-M2T2 


Taking  the  expectation  of  (11)  under  Hq  and  manipulating  it  we  obtain 


P0(Ti  >  nm,T2  >  m n)  <  e~a'nTI'-a'nr»E0[ea'T'+a'T* ] 

/—  .mrfj?  ncr?  si 
=  v2tt  exp[—  -1  4-  — +  np\2cr\(T2s\S2 

-si n(V\  ~  Moi)  -  s2n{T]2  -  M02)] 


(11) 


(12) 


Following  similar  steps  for  the  above  bound  we  obtain  for  tj  >  0,  t2  >  0,  and  g,j  >  0,  q;2  >  0 
and  rii  >0,  r,-2  >  0 

Px(Ti  <  nT]UT2  <  nr)2)  <  etinr>'+t'nr» El[e~t'T'-t2T 2] 


/—  rncr?s?  nalsl 
=  v2x  exp[  —  +  — +  np12<ri<r2s1S2 

+«i»(»71  “  Mu)  +  s2n(T)2  -  M12)] 


(13) 


under  #1, 


^■(Tj  >  nr/i,T2  <  11772)  < 
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y—  ,notqU  naiqh 
=  v  2ir  exp[ — -  npi2cri(72g«i9«2 

-9iin(»?i  -  Mil)  +  9i2n(ij2  -  Mi2 )]  (14) 

under  Hi,  i  =  0, 1  and 

Pi(Ti  <  nVl,T2  >  nift)  <  e+ri'n"-r»n,nEi[e-riiT'+ri2T'] 

.n<7?r2j  nerfr?, 

=  v2ir exp[ — —-**•  + — -  npi2«TiCT2r,iri2 

+r,1n(T?1  -  -  ri2n(r?2  -  M«2)]  (15) 


under  J?,,t  =  0,1.  The  four  bounds  computed  in  equations  (12)-(15)  give  information 
about  the  performance  measure  defined  in  (10).  The  positive  constants  can 

be  adjusted  for  setting  the  exact  form  of  the  bound.  Since  the  weight  (c2)  of  Pq(1,  1)  or 
Px(0,0)  is  greater  than  that  (ex)  of  P;(0, 1)  or  P,(1,0)  for  i  =  0, 1,  we  first  minimize  the 
bounds  in  (12)  and  (13)  with  respect  to  (51,52)  and  (<i,t2)-  If  we  minimize  (12)  with 
respect  to  (5x,52),  we  have 


P0(Ti  >  nrji,T2  >  nq2) 

<  -\/27rexp{  — 


,(Vi-Poi)2  ,  {I2-M02)2 

2  \  1  n  T 


2(1  “  P12)  ai 


°2 


2pl2{vi  -  Moi)(V2  —  P02) 


0\a2 


]} 


and  the  corresponding  (si,s2)  are 


.  __  {r]l  -  Mm)<72  ~  (>72  —  M02)pi2<?l 
1  (1  -  Pl2)al2<T2 


52  = 


(V2  ~  P02)V\  ~  (*?1  ~  M0l)Pl2<^2 
(1  ~  PllW^l 


(16) 


(17) 

(18) 


where  0  <  p\2  <  1.  Similarly,  if  we  minimize  (13)  with  respect  to  (<i ,  <2)>  we  have 


Pi  (  Pi  <  nr]uT2  <  nrj2) 
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^  rm _ i  »  r(/in  -  Vif  ,  (a*12  -  V2)2 

2pi2(Mll  ~  *7i)(M12  - 
0102 


and  the  corresponding  (ij,^)  are 


f  _  (Pn  ~  Vi)***  —  (M12  -  *72)Mi20i 
1  ~  (1  ~  Px-iWo* 


<2  = 


(^12  -  -  (Mil  “  »?l)Pl2^2 


(1  -  p?2)tr22cri 

Associating  the  restrictions  sk  >  0  and  tfc  >  0  for  fc  =  1,2,  we  have 


(19) 


(20) 

(21) 


Vl  -  M01  ^  V2  —  Mo  2 

> - P12 


01 


<r2 


V2  ~  M02  ^  t?i  -  M01 

> - Pl2 


02 


<*i 


and 


Mil  -  Vl  ^  P12-V2 

>  - pi2 


01 


02 


M12  —  V2  „  Mil  ~Vl. 

>  - Pl2 


(22) 

(23) 

(24) 

(25) 


02  01 

Let  us  now  consider  (14)  and  (15).  We  can  minimize  (14)  with  respect  to  (r^r^), 
or  (15)  with  respect  to  (qn^qn)-  However,  either  minimization  will  result  in  conditions 
contradictory  to  (22)-(23)  or  (24)-(25),  if  the  constraint  r,fc  >  0  or  qik  >  0  for  t  =  0, 1;  k  = 
1,2  is  to  be  satisfied.  Thus  we  choose 


Vi  ~  M01  _  _  „ 

foi  — - 5 — ’  r°2  —  u 


M12  -Vl 

r  12  =  - 2 - ’  r”  ~  U 


(26) 

(27) 


and 


Vi  ~  M02  _  _  „ 

902  — - 5 — »  *?01  ~  6 


(28) 
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Mu  -  m  _  _  „ 
?11  =  - 2 - ’  ?12  —  0, 


(29) 


which  give  the  following  bounds  on  (14)  and  (15). 


Pi(Ti  >  nr?i,T2  <  ntfr)  <  v^exp[--— ^  — —  ] 


(30) 


and 


P.(Ti  <  n7?!,T2  >  n%)  <  \Z2tt exp [  — —  ] 


(31) 


Since  all  parameters  and  g,*  for  i  =  0,1  and  k  =  1,2  are  nonnegative,  the 

constraints  to  be  satisfied  by  and  <Jk  are  presented  in  (22)-(25)  and 


Mo  it  <Vk<  MiJfc 


(32) 


for  k  =  1,2.  In  the  Sections  III  and  IV,  we  choose  suitable  thresholds  rjk(h  =  1,2)  that 
satisfy  (22)-(25)  and  (31). 

Finally  the  form  of  the  bound  on  the  average  cost  is 


E[C{dud2-,k)\ 

<  +  v^exp[^| ^t\} 

+c2v^exp{-^rT[<^21 £  +  <*  ' -  «)! 


2(1  -Mu) 


cr2'‘ 


2Mi2(»7i  _  Moi  )(i?2  -  M02) 


(71(72 


]}} 


+0  -  AMc^expl^L^a)!,  +  v^exp[-"(^-W2)2]} 

+C2^exp{-— +  (ffiAaZ 
2(1  -  Pl2)  CT1  <^22 

2Mi2(i7i  -  Mn)(i?2  -  j 

<71(72 


(33) 
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III.  Dependence  of  Observations  Across  Time 

In  this  case,  there  is  no  correlation  between  the  two  sensors.  The  two  sensors  make 
their  own  decisions,  according  to  local  observations,  and  are  coupled  through  a  common 
average  cost  function.  The  optimal  test  is  shown  to  be  the  likelihood  test  with  a  data- 
dependent  threshold  (see  [1]).  The  computation  of  the  optimal  thresholds  is  complex  and 
depends  greatly  on  the  probability  distribution  of  the  observations.  Here  we  consider  a 
suboptimal  approach  by  using  the  Central  Limit  Theorem  and  the  bounds  derived  in  the 
previous  section.  The  determination  of  the  thresholds  is  easy  to  implement  and  for  large 
sample  sizes  it  only  depends  on  the  mean  of  the  nonlinearity  under  either  hypothesis. 

Since  the  correlation  coefficient  pn  in  Section  II  is  zero  for  this  case,  the  bound  of  (33) 
in  Section  II  from  (16),  (19),  (30)  and  (31)  is 

Bd  =  A{d VSjexpl-  -H-civ^expl  ] 

+e^exp[T"(^_-p)V."(^l21} 

+(1  -  A  |  {  c  i  ex  p  j  —  '  1  pxp[  7-  ^  i*-1 2  -  ] 

+ -y  i>  (34) 

where  p\k  =  pek  (k  =  1,2)  for  the  weak-signal  model  of  Section  IIA.  Notice  that  there 
are  two  parts  in  (34):  one  is  the  error  probability  under  Ho,  while  the  other  is  the  error 
probability  under  H\.  Using  for  each  part  the  fact  that  as  n  — ►  oo 

aienos +6ients  w2ai61e(noj+nfcj)/2  (35) 

with  ai,&i  positive  constants  and  02,62  negative  constants,  we  can  approximate  the  bound 
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in  (34)  by 


Bd  *  A/4exp{^t(2!^pl£+<^p)!]} 

+(l-A)4exp{^“[(24«l>!+(^£]},  (36) 

o  Uj  (J  2 

where  A  is  a  known  constant.  Since  the  optimal  thresholds  are  hard  to  compute,  we 

determine  them  in  a  practical  way.  As  mentioned  above,  the  exponents  in  (36)  come  from 

two  types  of  error  probabilities.  These  error  probabilities  depend  on  the  distributions  of 

the  data  and  cannot  be  known  a  priori.  To  balance  these  unknown  error  probabilities  so 

that  we  do  not  bias  either  hypothesis,  we  pose  the  condition 

(*h  ~  Moi)2  +  (t?2  -  M02)2  _  (*7i  -  Hd\f  +  (q 2  -  M92)2 
a\  a\  a\  a\ 

for  all  ^0 k,  HBk  and  0k  (k  =  1,2).  One  solution  of  (37)  for  (771,  772)  is 

=  *=1,2  (38) 

Notice  that  constraints  (22)-(25)  and  (32)  are  satisfied  automatically.  Thus  the  bound 


(36)  with  r]k(k  =  1,2)  given  by  (38)  is 


B, „  »  4  ex pAL^r^/-  +  fa^ii) 

O  ■*  (To 


Minimizing  the  average  cost  defined  by  (39)  is  equivalent  to  maximizing  the  following 
exponent 

»(Wi(gi)  ~  m(gi))2  n(fm(92)  ~  HQ2(92))2 
°i(9i)  ^{92) 

_  M2  f  [(Wl(gl)  ~  MOl(gl))/^]2  [(^W(g2)  ~  ^02(g2))/^]2,  x4Qx 

*l(gl)  *f(02-)  '  ^ 

Recall  that  the  weak  signal  has  the  form  9  =  M/y/n ,  hence  as  n  — *•  00,  0  — *•  0  and  (40) 


becomes  proportional  to  the  following  performance  measure 

t/  ..  _  \  {dEe[9l]fd0}Lo  ,  {dEe[92)/d9}Lo 

J{9u92)  =  - 3771 - + - 72 T~\ - > 

^(flh)  ^2(52) 


11 


which  corresponds  to  the  ARE  in  single-sensor  detection  (see  [3]).  Since  the  decisions  of 
the  two  sensors  are  independent  of  each  other,  we  can  maximize  each  term  in  (41)  with 
respect  to  gk(k  =  1,2).  Notice  that  each  term  in  (41)  is  invariant  under  the  scaling  of  its 
gk-  Using  an  approach  similar  to  that  of  [3],  we  have  the  following  integral  equations  for 
</*(£=  1,2). 

-  f'ok(x)/fok(x)  -  f  Kk(x,y)gk(y)dy  =  gk(x),  k  =  1,2  (42) 

J  —  OO 

where  gi0,k(x)  =  —fok(x)/ fok(x)  is  the  locally-optimum  detector  (see  [3])  and  the  integral 
kernel  Kk(x,y)  has  the  form 

m 

Kk(x,y)  =  fN-+1/Nl(y\x)  -  (2m  +  l)fok(y),  k  =  1,2.  (43) 

i=i 

For  the  <f>- mixing  noise  model  m  — *■  oo,  while  for  the  m— dependent  model  (see  [3])  m  is 
finite.  In  the  simulation  examples  of  Section  V,  we  set  c\  =  2,  c-i  =  1,  and  A  =  1/2,  which 
corresponds  to  the  criterion  of  minimizing  error  probability  in  single- sensor  detection. 
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IV.  A  Simple  Case  of  Dependent  Data  Across  Time  and  Sensors 

If  the  weak  signal  observed  by  the  two  sensors  passes  through  the  same  channel,  the 
statistics  of  the  observations  obtained  locally  by  each  sensor  can  be  modeled  as  being 

identical.  Therefore,  Hoi  =  M02  =  Mo>  Mfli  =  M02  =  an^  o\  —  ~  °  In 

case,  we  use  the  same  detection  structure  for  each  sensor  and  thus  the  same  nonlinearity 
5l(.)  _  g2(.)  =  g(.)  and  771  =  772  =  77.  The  bound  described  by  (33)  has  the  form 

Bd  =  A{2\/2xc1exp[— --^^-^-]+V/2^C2exp[Y^^^^3-]} 

+(1 —  ^X2V^ciexp[— — ^^|-^]+N/27rc2exp[-^^^^-]}  (44) 

Using  the  balance  conditions 

-ti(tj-ho)2  _  -njv-ne)2  (45) 

2^  ~  2a2 

-n(rj  -  /xp)2  _  -n(rj  -  fie)2  (45) 

(1  +  P12W  (1+Pl2)v2  ’ 

we  obtain  one  solution  for  rj,  i.e., 

v  _  Mo  +  (47) 

Again  conditions  (22)-(25)  and  (32)  are  satisfied  with  this  threshold.  Thus,  the  bound 
obtained  by  employing  this  threshold  is 

Bd  =  «xp{^^}  +  v^c2  exp{^^}  08) 

There  are  two  exponents  in  (48),  namely 

„  ,  .  Mpeid)  -  Mo(fiO)2  _  .  r2  [(Mg(g)  ~  Mo(g))/^]2 
^  = - 2^5)  "  8^2(5) 


and 


D  ,  .  n(Mg)  -  Mg))2  _  ,f2[(Mg)-Mo(g))/0]2 
2(5)  (1  +  P\2(g))v2{9)  4(i  +  p\2(g))v2{9) 


(49) 
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For  the  same  reason  as  that  of  Section  II,  these  exponents  approach 


Ri(g)  =  M2 


{[dEo[g]/d6  ]9=Q}2 

%<r2(g) 


and 


R2(g)  =  M 2 


{{dE[g}/dO}e= o}2 

4(i  +  pi2(g)W(g) 


(50) 


as  n  — ►  oo  and  ^  -*  0.  The  optimal  choice  of  the  nonlinearity  <?(.)  that  minimizes  (48) 
is  hard  to  identify.  However,  it  can  be  shown  that,  for  each  term  R\  or  R2,  there  is  an 
optimal  solution  for  g(.).  Therefore,  we  adopt  the  following  practical  solution:  we  optimize 
(maximize)  Ri  and  R2  in  (50)  with  respect  to  g(.)  separately,  and  choose  the  g(.)  that 
gives  better  performance  (smaller  average  cost).  For  R\,  the  same  integral  equation  as 
(42)  of  Section  III  has  to  be  solved  for  the  optimal  nonlinearity.  For  #2,  we  can  derive  the 
integral  equation  satisfied  by  the  optimal  nonlinearity,  for  following  similar  steps  to  those 
in  [3] 

Notice  that  for  all  a  ^  0,  Ri(g)  =  Ri(ag),  namely  R2  is  invariant  under  the  scaling  of 
g.  Thus,  maximizing  R2  with  respect  to  g  is  equivalent  to  maximizing  (/ gf0 )2  and  thus 
—  /  5/q,  since  —  f  gfo  =  |  f  9  fo\  because  of  (6),  under  the  constraint  that  (1  +  pu)^2  be 
equal  to  a  constant.  Let  go  maximize  R2  under  the  assumption  (6) 


go  =  arg{maxH(g)},  (51) 

where 

R(g)  =  -  J  gfo  +  Al(i  +  Pu(g)W(g)  (52) 

with  Xl  being  the  Lagrange  multiplier.  Comparing  the  above  H(g)  with  that  in  [3],  we 
note  that  there  is  an  additional  term  P\2(g)&2{g)  which  we  have  to  consider  in  the  course 
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of  pursuing  optimal  g.  This  term  has  the  following  form  for  ^—mixing  dependence  across 
sensors 

Pu{9)o2{g) 

=  Ita  i  •£  ■£  £to(*.!,))  -  «)(«(*?’)  -  /*»)] 

,=1  j=l 

=  ^b(*iX))5(®i2))]  +  2  S  ^'lfl(*i1))fl(a!j,+i)]  -  (2m  +  1  )nl  (53) 

j= l 

where  m  is  finite  for  m— dependent  noise  and  m  — +  oo  for  (^—mixing  noise. 

Let  us  denote  the  variation  of  g  as  Sg  and  let  J3(e)  =  H(g  +  (Sg).  Then  the  necessary 
and  sufficient  conditions  satisfied  by  go  for  arbitrary  6g  is 

4(0)  =  0  (54) 

and 

Ao(0)<0.  (55) 

Referring  to  equations  (12)  through  (13)  of  [3]  and  using  (53)  above,  we  have  the  following 
necessary  condition  for  go 

/OO 

{-ft>(x)  +  2\L[g(x)f0(x) 

-OO 

(x,y)+Mx,y))dy]}6g(x)ix  (56) 

where 

M*,v)  =  (fNWiNw(x,y)  + fNw^)(y,x))/2-2f0(x)f0(y) 

and 

/i(*>  y)  =  fsAD  Nd)(x,y)  + f  (i)  w(y,x) 

iyl  +  l  Jyi  »/V>+ 1 

+/Ar(1)  wd)  (*>»)  +  /yd)  wd)  (y,i)  -  4/o(r)/0(y) 

1  ’  >  +  l  1  J  +  l 
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with  i)  ^i)  being  the  joint  probability  density  function  of  jV^  and  JV ji\and  f^/i)  ui) 

"1  •ivj+ 1  "i  '^>+1 

the  joint  density  function  of  ivj1^  and  JVf+i-  Prom  (54)  and  (56),  we  deduce  an  integral 
equation  similar  to  the  one  in  [3]  for  arbitrary  Sg,  namely 

/°°  ”L 

9(v)(52fj(x,y)  + fo(x,y))dy]  =  0,  (57) 

■°°  j=i 

where  Al  is  a  scaling  factor  of  g.  From  (55)  we  obtain 

2XL(1  +  Pi2(6g))cr2(6g)  <  0  (58) 


Since  pi2(.)  <  1,  (47)  (a  sufficient  condition  for  go)  holds  for  negative  A If  we  set 
Al  =  —1/2,  the  integral  equation  to  be  solved  for  go  is 

-  fo(x)/fo(x)~  f  Kc(x,y)g(y)dy-  g(x),  (59) 

•/— OO 

where  gi0(x)  =  — /o(x)//o(x)  is  the  locaily-optimum  detector  for  this  case  ,  and  Kc(x,y ) 
is  the  kernel  of  this  integral  equation  and  has  a  form 


Kc(x,y)=  (/N(2)/N{i)(y|x)  +  /iV(i)/N<2)(y|x))/2-2/o(y) 

m 

+/^)/^i)(y|x)+/N{o /^(yjx)  -  4/0(y)] 


+fNmi/N(i)(y\x)  -  2fo(y)} 


(60) 
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V.  Simulation  Results 


In  the  Examples  below,  we  consider  m— dependent  noise  with  m  =  100  and  sample 
size  n  =  1000.  In  Figures  1-8,  we  plot  the  receiver  operating  characteristic  (ROC)  for 
Gaussian  (Figures  1,  2,  5  and  6)  and  Rayleigh  (Figures  3,  4,  7  and  8)  noise  processes. 
In  these  figures  the  two  types  of  average  cost,  Eq  and  E\,  are  normalized  with  respect 
to  A  and  1  —  A  respectively.  Examples  1  and  2  correspond  to  independent  data  across 
sensors  (Section  III),  while  Examples  3  and  4  correspond  to  dependent  data  across  sensors 
(Section  IV). 

Example  1:  Denote  by  the  noise  of  sensor  k  at  time  instant  i  for  k  =  l,2;i  = 
1,  •  •  -  ,n.  Consider  the  noise  processes  characterized  by 

N[k)  =  Vlk) 

Nlk)  =  pkN\k_  1  +  yjl  -plvlk) 

where  Af(Q,  <7j?)  for  i  =  2,  •  •  • ,  n;  k  =  1,2  are  i.i.d.  Gaussian  random  variables,  and 

Vf>  are  independent  of  each  other  for  all  i  =  1,  •  •  • ,  n.  Thus,  for  k  =  1,2 

fok(Nlk))  =  exp[— (AT/fc))2/2<r|]/(2xcr^)1/2,  i=  l,---,n 


and 


f(k\Nlk),Nlk\) 

2»(i  -  pVYI24  expWi  -  pI')1^2  +  {N'+l)2 

-2piN}k)Jvlkl]} 


where  p\  =  for  j  =  and  k  =  1,2.  Under  hypothesis  the 

observations  xjk^  =  N^;  under  hypothesis  Hi,  =  6  +  Njk\  The  particular  case 
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with  px  =  0.9,  pi  =  0.7,  <t\  =  3,  oi  =  5  is  illustrated  in  Figures  1  and  2  for  different 
T7x .  In  both  figures  solid  lines  represent  the  ROC  of  the  detector  using  the  nonlinearities 
</fc  ( k  =  1,2)  and  dot-dash  lines  represent  the  one  using  the  likelihood-ratio  detector  for 
i.t.d.  data. 


£i[c]/(i-M  St**]/1 


E,[C]/(1-M 
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Ave.  Cost 


and  a  second-order  joint  pdf  given  by 


fw(z[k\z£\) 

zik)zii\  -.-r  1  M k)f  ,  Mil! 

{I  -  p13)<t\<tI  {  2(1  -pl3y  a\  a\ 

pizjk)Z^kl 

•/°[rf-V~-]>  **=!>•••,»;*  =  1,2 

(1-P* 


]} 


Now  consider  the  observations  of  the  two  sensors.  Under  Hq  the  observations  zfk*  are 
Rayleigh  distributed.  Under  H\  the  observations  zjk^  has  the  following  form 


z}k)  =  VWfc)  +  of  +  (Y}k))\  i  =  1,2 


which  has  a  Rician  distribution  for  nonzero  and  asymptotically  a  Rayleigh  distribution 
as  0  — *■  0.  In  fact,  these  observations  correspond  to  the  envelope  of  a  weak  signal  in 
narrowband  noise.  Although  it  cannot  be  modeled  directly  by  an  additive  noise  model,  we 
use  it  to  test  the  detection  schemes  derived  in  Sections  III  and  IV.  In  this  case,  the  locally- 
optimum  detector  in  (42)  and  (59)  has,  for  k  —  1,2,  the  form  gi0lk{x)  =  —f'ok(x  )/(*/ofc(*)) 
for  Section  III  and  gi„(x )  =  - /o(aO/(z/o(z))  for  Section  IV  (see  [6]).  Figures  3  and  4  show 
simulation  results  for  this  case  with  parameters  (/?i,P2,  and  <72)  being  the  same  as  those 
in  Example  1.  In  these  figures  solid  lines  and  dot-dash  lines  have  the  same  meaning  as 
those  in  Example  1. 


EJC]/X  E,[C|/(1-M 


FI*.  3  •),— MOO 


EJC1A 


E.(C)/(1-M 
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Example  3:  Consider  again  the  noise  model  given  in  Example  1.  Suppose  that  0\  — 
02  =  o,  P\  =  P2  =  P  and  the  sequences  V^\  v/2^  are  correlated  through  the  correlation 
coefficient  pv  as 

pv  =  E[^(1V/2)]/<r2.  Thus,  for  j  =  l,  --,n 

EiN^N™ )  =  <jpW 

Figures  5  and  6  show  simulation  results  for  the  case  of  p  =  0.7,  a  =  5  In  Figure  5, 
pv  =  0.4,  while  in  Figure  6  pv  =  -0.4.  Let  g  and  gc  denote  the  nonlinearities  obtained 
by  optimizing  the  exponents  Rx  and  R?,  respectively.  In  these  figures  solid  lines  represent 
the. ROC  of  the  detector  using  the  nonlinearity  g ,  while  dash  lines  and  dot-dash  lines 
represent  the  ones  using  the  nonlinearity  gc  and  the  locally-optimum  detector  for  i.i.d. 
data,  respectively. 


EJC]/X  E,[C]/(!-M 


Threshold  (rj) 
rig.  5  p, 1-0.4 


*yci/x  E,[c)/o-x) 


Threshold  (fj) 
FI*  8  Pit*- 0.4 


Example  4:  Consider  again  the  Rayleigh  noise  processes  given  in  Example  2.  Let  the 
parameters  (ct*  and  pk  for  k  —  1,2)  be  the  same  as  those  in  Example  3.  Furthermore, 
define  pw  =  E\wl^w\2\l a2  and  let  pw  —  pv  for  i  =  1,  •  •  • ,  n.  Figures  7  and  8  show  the 
results  for  the  cases  with  pv  =  pw  —  0.4  and  pv  =  pw  —  0.9  respectively.  In  both  figures, 
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solid,  dash  and  dot-dash  lines  have  the  same  meaning  as  those  in  Example  3. 


CJCJA  £,(C]/(l-X) 


EJC1/X  E,[c)/(1-M 


Fig.  8  p„«0.8 
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VI.  Conclusions 


In  this  paper  we  extended  the  memoryless  detection  of  a  known  weak  signal  in  depen¬ 
dent  noise  to  the  case  of  distributed  two-sensor  detection  from  correlated  sensor  observa¬ 
tions.  The  correlation  of  noise  across  time  and/or  sensors  is  characterized  by  m-dependent 
or  ^-mixing  models.  We  devised  two-dimensional  Chernoff  bounds  on  the  average  error 
probability  of  the  two  detectors  and  from  those  obtained  performance  measures  resembling 
(although  distinctly  different)  the  asymptotic  relative  efficiency  (ARE)  for  the  two-sensor 
problem.  Optimization  of  this  performance  measure  led  to  linear  integral  equations  whose 
solutions  provided  the  optimal  memoryless  nonlinearities  used  by  the  sensors.  Our  results 
are  applicable  to  both  cases  of  symmetric  and  asymmetric  correlated  noise.  The  simu¬ 
lation  results  obtained  suggest  that,  regarding  the  average  error  probability  of  the  two 
sensors,  employing  memoryless  nonlinearities  that  take  into  account  the  correlation  in  the 
samples  of  the  two  detectors,  is  always  better  than  using  the  locally  optimal  nonlinearity 
that  ignores  the  dependence  between  samples.  Takin  into  consideration  the  correlation 
of  observations  across  sensors  improves  the  performance  when  the  overall  correlation  is 
negative  for  Gaussian  observations  or  heavy  positive  for  Rayleigh  observations. 
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